OOOOHENt BBSOBl 



£0 167 661 



CS 025 a 05 



A,0THOB 
ttlTlE' 

JNSTITOTIjON 



SPCNS AGENCY 
FUe DATE ■ 
.NOTE 

AVAILABLE FBCH 



EDBS PBICE . 
DES.CBIPTOBS. 



IDENTIPIEFS" 



BcCray, Paul 

Learning A.ssessiii'ent in vocatlbnai Evaluation. ' . 
Nlsconsin Univ^ - stout* (^enononie. Dept. o^ 
Bchabllitution and Manpover Services, Materials\ 
Development cewter. ' '* .• 

'Be'hab'illtatiQn Services Administration (CHEN) , .. 
Washington* C.C. ^ ' 

Apr 79 " . . . ■ ' J 

DHEW-12-P-55307/5'^ 

23p.* . • * . 

Materials- Development Center* .stout Vocational 
Behafailitatiofi Institute, Oniversity of 
Wisconsin— Stout* Me.nciD6nie*' 5U751 (SI.QO) 

HfOI/PCOl Plus Pc^stage. 

♦Disabilities: Guidelines: Instructional Development; 
Job Placement: Job**7raining; ^Learning; Performance 
Tests: *Testipg: *vocationa*l. Aptitude; ^Vocational . 
Behabilitaticn: KWctlc Sample Tests . ' 
♦Vocational Evaluation ' 



ABSTBACT , ■ ^ . 

I The purpose of this dccuaent is to. help vocational 

evaluatcrs understand (1V liow the concepts of learning and 
performance relate to vocational evaluation:. <2) why learsing \ 
Assessment is- important: .and (3) bow it- may be incorporated into <r6ik 
saople testing'. The text is divided into three- parts. Pftft 1 defines 
the learning assessment process. Part ,2 provides the rcationale for 
learning asse'ssment by discussing th« following reasons: assuring 
performance testing readiness; .prcviding instruction; improving, 
client awareness: and providing benefits for jcfc placement and 
training. Finally* part 3 presents the procedures for practicing '* * 
learning as'sessment. .These procedures include methods of sep,arating. 
learning and performance, of devel'cping appropriate instructional 
techniques* and of adapting standardized Work sample instriictions. 
(EM) • • •• 
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• Introduction • ' - . 

Assessing haw client learns Is ohe of the most important functions of 
vocational evaluation. There a two. basic reasons for this. First,! the ways 
In' which an individual can learft information certainly- have a strong impact on 
.•their vocational dfevelppment. All ^cbs, no matter how simple, require some . 
degree of learning, yet disahilities such as blindness, deafness, mental re- 
' tardation, and aphasia obvioii$l> limit . some of the 'modes by which a person may 
♦ .learn. . Yet', In most cases, once the. learning problem «has be^n identified, 
• -modifications of the.1nstru<*t1onal or training procedures can be made, e.g., 
audi'otap,ing of written materi.al'$ or sign language.. Such adaptatibns allow . 
handicapped persons to learn behaviors and skills which would not otherwise.be 
posslWe. Thus, th.eir personal, soci?l, and vocational opportunities are 
greatly expanded. . . ■ ^ .* - • , V 

Secondly, with regard"to cVffcatiibnal evaluation and particularly work and 
job sample testing, an individual's ability to learn to follow a standardized 
set of instructions has a significant influence over performance, capabi 1.1 ty.* 
For if a client is unable to understand the instructions provided in a work 
<r"5wnple, it is unlikely tha-t he will acquire the requisite behaviors necessary 
N to perform' the, assigned task. In many such cases the resul ting. poor perfor- 
' mance'is erroneously interpirete'd as indicating- a lack of task. related ability 
rather than \evi den ce of specific or general^* learning disturbances. In such, 

■ cases, the learning problcmSlb'ften "remain. completely undetected, and, thus 
■little or no effort is made- to modify the Instructional format so as to facil- 
itate client le'arnirtg. - #1 ' = ' 

If thi'S problem is to . be 'oyercome., evaluatbrs must include learning as - 
- ses^ment as 'part of .the evaluatibrv process. However, the term learning 
assessment does not denote the traditional concept of measurincf a client's' 
IQ or so called "potential to'leajn.". Rather it refers to" evaluating and . 
understanding' how a client Teams', e.g., through written instructions, or^il ■ 
directions', an3aeman«'trati6ns. • Understanding how a person learns, is-partic- 

■ uiarly crucia.1 .when working with ^severely handicapped individuals who. may be 
unable to learn -a task via one instructional fortnat like written, but who can 
learn the same task if another instructional technique, such as demonstration, 
is. provided.^ ' ' . * . ; • 

"^••Before any decisions as to tl4'eht capabi.Ti tie's are "made,, it is imperative 
. • that the evaluator be reasonably certain that/after a stamslai'rdtzed in^truc- " 
tional4 format has been provided, the'client: .(1) perceived^ and underswod the 
^. instructions,' (2) was taught the proper use of -the tool i and equipment, 
(3) all the steps and motions'were learihed, an^ (4.) he was made aware of the 
. ' desired outcomes. If the client fails. to satisfy an^ of these criteria, then ' 
the evaluator must provide alternative 'instructional procedures which will 
h^glp the .client learn what he is. to do. It Is essential that performance 
testing not occur until all* of the aforementioned objectives are achieved. 

Unfortunately, at the present time few "in-house" work samples or commer- 
cially developed work" samgle systems possess systematic, o.bje<ftive standards 
, which outline when the aforementioned criteria are considered to have been 
. reached by the client. Add to, this. problem the facts that: ' (1) many severely 
•handicapped" clients have subtle, and complex learning disabilities which are 
not easily identified, and (2) ofteu clients make a special effort to mask 
their J^rning handicaps; it is not difficult to see that assessing the 



ways 1n which a client's 1 earning skills influence his performance capabilities 
M a difficult yet critically, important f^cjor in understanding vocational po- 
tential. , . . 

The purpose of this pyblicatio.n 'is Whelp vocattonal evaluators under-: 
starfd: (D'how the concepts of Teaming and performance relate to. vocational . . 
'evaluation,' (2) why lee.ming assessment is important, and (3)^ihpw It may be 
incbrlJorajtcd into work sample testing. By understanding these concerns, voca.- 
tional evaluators will gain important insight into the relationship ^mong ' 
learning, performance, and vocational assessment. and *^us provide a more 
ef fective' service CO the clients. \ 



i . ' Paul McCray, M.S.*^ ^ 
I -.March,' 1979 
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PAI^T I • . . - . 

DEFINING THE LEARNING ASSESSMENT PROCESS-^ 

Learning; and Performance Phases of Work Sample Testing ^ 
' . ■ " .* . • 

Ellis (1^72) defined learning as "a relatively permanent process that is 
Inferred from performance changes due to practice" (p. 4). Within this defini- 
tion there, are four important points'to k^ep -in. mind: ^ " . ^ 

■ • . ■ . ••. • 

* (1), Leerhing is an inference which means that it is not something- 

directly obs.erved. Thus liearning Is an inferrejEfc^or hypothetical r 
concept liTce gravity or electricity. We never see gravity directly; 
^ WG observe falling objects and therefore infer that .such a process 
exists., (2) The concept of learning is tied to performance, 'but is 
not the same as performance. Hence,, a distinctiort is made between 
learning and performance. Various performance 'indicators are em- 
plbyed'to infer learning suth as number of correct responses , errors, 
percentages of correct ..responses, response rate, response speed, etc. 

(3) The concept of learning is tied to conditions of practice which ' 
serves to distinguish learning from performance changes attributable. - ' 
to other conditions such as fatigue, maturation-, or drug states.. 

"this simply emphasizes that 'the conditions' antecedent to learning* 
are practice conditions as distinct from other kinds of conditions. . 

(4) Learning is .a relativoly permanent process, which is an assumption. 
/ which is useful in order to distinguish learning from oth6r more tera-^ 

. porary. processes such as sensory, memory qfir short-term iTiemory. (Ellis, 
, ' pp. 157-158) 

> 

Thus, for purposes *^f vocational evaluation, one may generally view 
learning assessn]gnt*as an inferential process and* performance ^assessment* as a^ 
measurable or quantifiable representation of the extent of learning that has 
taken' place.. The most significant points to remember/ are : (1) learning and 
performance 'are closely related but- dis-ti net .^concepts, and (2) performance 
can be strongly influenced by. the degree of ,1 earning which precedes it.,. 

With regard to vocational evaluation* Revell and Wehman. (1978) have 
separated the concepts of learning and performance, by identifying two distinct 
pliases-^of work and .Job sample testing. The' acquisition or learning phase 
occurs during the period in which the client acquires the re^iuisite skills and 
concepts needed to perform the task. It is at 'this time that the client learns 
-what 'he is to do and the motions j'^oncepts , tool uses,* etc., needed to carry" 
OsUt the assignment. ' It necessarily involves various degrees of training since 
the -evaluator .instructs the client as to* the desired outcomes as well ,as how tp 
assemble or disassemble an'obje-ct, read a chart, use a machine, etc. On the 
other Jiandf the performance or production phasfe fo.llows the learning phsse." 
During the performance phase the client actually executes the learned behaviors 
under formal testing, conditions. For example, during the, learning phase a clir 
enf may have been instructed as to how to assembl-e an object and then was 
allowed to practice the assembly without regard to speed, quality, etc. How- 
ever, unlike the learning pha^e, during the performance phase careful con- 
sideration .is given to the speed, quality, etc., with which the client 
performed the task, ' 



The goal of \he learning ph^se is forythe client to thoroughly understand 
what he is going to do- as well as how to. do It," i.e., he possesses all the be- 
haviors needed to perfoN a given task. Assuring that a client thoroughly 
learns al^ aspects of a task prior to test performance is not an easy job; It 
requires the evaluator to identify measurable and concrete bbjectives which 
define when adequate leafni fig has' taken place, so that performance testing may 
begin. *These objectives must be representative of the behaviors, ski.l Is, con- 
cepts, etc., required during the performance 4)hase» (this subject will-be • 

'discussed mor^. thoroughly in Part III). The goal of the production phase is 
different. -"In. this calse, the evaluator wants to obtain some sort of measure 
which is a valid and reliable estimate of the client's performance capability. 
This measu»'e. ^s usiiaVly a quantifiable icore of some kind,'^e.g., percentile - 

.rank, gV'acfe" equivalent, tigie score, errtfr-s etc. Generally speaking, the per- 
formance score is regarded as an accurate measurse of the extent of learning 
that has taken place providing, of •couf'se, the cli^nt's motivation,, the testing 

•environment, etc., have all been carefully considered.- 

Thu's,''one can see that learning and performance are distinct entities Which 
share a cause 'and effect relationship.- Learning influences performance and per- 
fonnande suggests the extent- of* learning. Failure to thoroughly achieve the ' 
goals of the learning phase will have a negative impact on performance, since 
the client will begin the performance phase while still Ucking some of the ^be- 
haviors needed to competitively perform, the entire task. , The end result of. this 
problem is that if an evaluator fails .to identify the client's performance prob- 
lems as. being Yelated td an inadequate or incomplete -learm ncy Jhase, then the 
eva luator may easily attv-ib ute the clTent s poor .performahce tcf a l ack of task 
re lated ability . Thus, "I" client may be screened dut-;of a potential- training or 
eiripToyienT opportunity, not necessarily because of lack Pf .ability i- but because 
*of a learning problem whiciT prevents him from understanding what he is to do 
and/or- how to do it. - . 

For example, if (juring th& learning phase, a client who cannot read above 
a fir*st grade level is" given a series of work sample instructions which require 
sixth grade reading skills, he will'perform poorly during the performance^ phase 
* of testing. This, however, does' not necessarily mean, that the client lacks the 
ability to do the job, instead it' indicates -a learnir^g handicap, i.e., a limited 
' ability to follow written instructions. In order to determine if the client 
■ 'really lacks the ability to do the task, the instructions must then be provided 
by other methods , e.g. , oral or demonstration. Such modifications of test ad- 
ministration procedures are riecomme'nded by .CARF Standard 3.4.3.1.1.2 which 
states; ^ ^ 

appro.pria'te adaptive assessment tools and methods shall be used when- 
ever possible with individuals having sensory, communication, or other 
functional impediments (e.g.-,. visual , hearing, speech, language, cul- 
tural, pr learning disabilities ) which might invalidate otherwise 
•standardized procedures, (p. 28, Standards Manual for Rehabilitation 
• Facilities) • ' . . ' 

* " ■ • * • 

In addition to this, the joint CARF-VEWAA publication, VEWAA-CARF* V.oca- 
tional- Evaluation and Work Adjustment -Standards with Inte rpretive Guidelines^ 



and VEWAA Gj^^ssarv* ,' provides a clearer interpretalton of this standard. ^ 

The. intent- of .this ^standard is to assure that evaluatio'h programs 
modify or use\already modified tests, work samples, or other as- 
*. sessment tools to assure that they (evaluation tools) can ' ' 

. accurately reflect the person's aptitudes, abilities, potential, 
etc. For 3>;4mple, using a short",. timed test suclj as the WRAT to 
measure th® math abilities of a person with severe motor prbb- , , ' 
lems oM;he administration .of a test written in Enclish to.,a 
pe'rcon whose functional language is Spanish, would not meet th'e, * 
intent of this standard.^ Possible adaptations migh): include the 
> use of' recorded directions or Braille directions for the blind, 
translated materials 'for foreign' language groups, orTthe use of 
tests that have been developed for or account i^or disability-^ 
groups tn their norms, etc. (p. 5) . ' . \ * 

Thus, one can see that 'modifying standardized instructional formats is one 
important method of facilitating learning „among individuals- with speci^fic or 
general Teaming Sisabilities. Such niodifi.catiohs are, however, only*one com- 
ponent of the overall learning assessment process;^ Viewed in the brpadest 
sense, learning assessment is the process- of systematically evaluating how a 
person learns, identifying any limitations that-exist, and developing -appro- 
priate adaptive techniques which 'are designed to facilitate learning and, 
thereby, help.the cli-ent 'overcome his learning handicaps. 

.. • ' ^- . ^ ' 



/ 
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RATIONALE FOR LEARNIHG ASSESSMENU 

■• • • 

• • • ' - * • 

Having dei^ined leeTrning assessment, it is now important to look at some of 
the' reasons. why this process is important. .' . . • : . 

Assuring Performance Testing Read'in'ess , • . 

When a client's performance is substandard; it is not enough to simply 
note .it, automatfcally attribute it to lack of ability, and fJredict that the 
cli en t*s. potential in that area is limited. Instead, the evaluator must take 
the assessment process one step further in an effort to understand wh^ the 
client's 'performance, was substandard. Jhere^ay be a variety of reasons for 
poor performance including: 

1, * "inadequate 'instructional' procedures (client. doesn't iinderUand what to 

2, environmenJ:al factors (poor testing conditions) . . 

3, motivation (overly anxious to perform well , or disinterested) 

4,. lack of task related ability- V - 




ability in the tested^ area rather-than- that the client did not thoroughly under- 
•stand what'to do simply because infe instructional format required ftim to utilize 
sMlls which- were limited by. his learning disability. By including learning 
assessment as part of the evaluation process, the eviiluator is forced to-cDn- 
sider whether or not the instructional procedures provided in .the learning phase 
were appropriate for the individual. This activity helps assure that a valid 
picture of client performance capability emerges. 

For example, suppose an evaluator is working with<.a severely .retarded cli- 
ent who expre/ses an interest in working as a circuit board ass'embler. Based 
on the client's tested and expressed interests*, the' eval uatrSr decides to admin- 
ister. Jr^circu it board assembly work sample which utilizes a standardized written 
instB<ktional format during the learning phase. If under these circumstances 
the client' fails to acquire the skills needed for performance" testing, should 
the evaluator interpret this as necessarily meaning that the client lacks the 
task related ability and his potential in this area is, therefore, limited? The 
answer is certainly no, for such an assumption is premature. The.evakuator must 
first determine if the learning problem is ^the* result of other factors, e.g., 
■ inadequate instructional procedures, telt environment, pr. lack of motivation. 

^ ■ . * " 

In this case, the evaluator must seriously question whather or not a writ- 
ten instructional format was appropriate for an individual with severe y limited 
reading skilU. Is there a reasonable possibility that the client coul^ learn 
the skills and concepts if other instructional techniques were provided? The 
answer is yes-; therefore, the evaluator must break' away from the standardized 
instructional format (in this case, written) and try other instructional meth- 
ods, for example, the evaluator might provide the instructions orally, ^ive 



demonstrations, or use a combination of the two technicfues in order to' attempt 
to facilitate, client learning. .If, after thoroughly exhausting all. instruc- 
tional strategies, the client -is 'still unable to learn the task, then he must 
consider fKe test environment and the client'-s. motivation,. These two factors 
are frequently discussed in much of the more traditional psychological testing 
Literature. That they can affect performance t^stin/g is certainly true. For 

example, if a^s^ries -of tests require a quiet., uninterrupted setting, yet the 
evaluato," allows .people to randomly, enter and exit the room, talk to one another, 
play radios, etc., then one can definitely say that the te,st environment was 
poorly control fed. Such distractions are likely heive a negative impact on 
performance and, therefore, the client's performance 'may not be 'representative 

*of his true abilities. Similarly, if a.cl*ient is flat fliotiva ted or interested in 
taking a test, his result.infl perfo^ance may not reflect his real .abilities.' 

' For example, sgme clients may randomly fill in a^ns we r, sheets ^simply because they 
don't want to^take the time to think through the ques.tions. 'Other, clients may 
bk so an)^iou5 to perform well .that' the^ '.' freeze- uff' and cannot answer questions . 
or perform tasks that would normally be easy fon them. Thus, one*can see that 

•the evaluator must consider whether or not these two factors,- along with the 
instructional 'format , w6re controlled well enough so as to-limiH their affect 
on performance. If they were, well controlled, then the eve.l.uator may -be rel- 

*atively certain that the cl ^nt's poor ]Derformance and difficulty learning the 
task suggests a lack of ability in 1\he area of circuit board assembly. If, on 
the-^fherf han.d, the evaluator finds that t^e client can learn the information 
if the instructional format is- modified, he will then have'gained significant 
insight into the client's learning^capabilities arTd 'will be able to apply this 
knowledge, to future testing situatipns !as well as training "and placement .recom- 
mendations. *' " • . 

- ■ . • .. / 

Instructional Techniques 

• • 

There are four basic methods of providing instructi^Dns to" a client. *^iiey 
'(.aelude: Vritten, oral, demonstration/modeling, and h^nds^'on. 

1. Written Method « 

The written method, .is perhaps^, the most compVex since it requires the 
learner to read information such as manuals, charts, maps, diagrams, etc., as 
well aS analyze and synthesize- the data. into a meaningful whole so that the 
desired behavioraV changes may 'be made.- For example, an auto mechanic is ofttn 
required to read repair manuals in order to correct ^compl icated. mechanical 
problems* ^ 

'Because the amount of time require to develop the skill of reading may 
nange from several months to many years, learning any information or skill via 
written instructions is'relatively difficult no matter how simple the actual 
task might be. 'For. example, 'sorting several different nuts and bdlts might be 
^ r.elatively simple joJa; "however , if .a clfent is required to read instructions 
prior to performance, then a sig*nificant prerequisite skill (reading^^ill pre- 
vent many clients from. (lerforming the work sample even though they may have the 
physical and intellectual capabilities to do the actual work. 

- Dyslexia is an example o.f & disability which limits one's ability to read. 
Although -an individual may have above average intelligence, if he j,s required 
to perform even thr> simplest task- by reading a set of instructions, he may not 
be abla to perforr the job. However, in such, a Ccise, the'evaluator should 



recognize thatf the performance problem reflects a specific learning disturbance 
and not necessarily a lack of task felated ability. Therefore, the evaluator' 
should provide the instructions by means of one of the other modes in qrder^to 
determine the "client's actual performance capabilities. 



't. Oral .Method 



' Like the written technique, the oral method is. verbally oriented and 
requires relatively sophisticated skills. The individual must listen to inf ov- 
ulation, and .organize it Into' ^n integrated pattern, yet unlike the written method, 
years of formal training are not necessary. Rathert this skill typically de- 
velops through hormaV maturation S9 that the infant ^begins tj^ understand many of 
the verbal commands of its parents and as tKe child's latiguage skills develop, 
so does its understanding of speech^ « • 

This method, however, is not entirely dependent Upon the phj^sical hearing 
mechanism. A handicapped individual ma^.be able to hear sounds qtiite normally, 
but his abililjy to organize, interpret, and understand auditory information may 
' e coijiplfetely. 'deficient. v ^ ' * 

For example, a client with recep.tive aphasia may be able to" hear every 
word his evaluator speaks, but .he is unable to organize it into meaningful in- 
• formation. Thus, he has excepti'onal difficulty making the desired behavior 
'changes or performing an assigned task. More importantly, for the evaluator, 
because the degree of impairment may vary, some clients will, be ab>e to' under- 
stand, a portion of the verbal instructions. They may be able to comprehenj 
concrete but not 'abstract concepts, 'thus., they may give the impression ^that 
.they have learn'ed the task an* understand all the instructions when-in fact 
*they have not. In such a* case, it takes professional expertise on the part of 
the evaluator to nifscern the interaction among disability, learning, and per- 
. form-ance. If the evaluator Hs not aware of how learning can affect performance, 
then he may erroneously assume th«ii4he client lacks the ability to perform thq 
' task rather than observing that-ihe relationship.aniong the Client's learning 
style, .the teacH^ri'g style, and tne.test adm'ini strati on procedure was not 
conducive to' obtaining a valid and reliable picture of the ;:lient's capabil- 
ities. , ' (/ 

3. Demunfttrati on/Model i ng^ Method . ^ 

The last two learning styles, demonstration/modeling and hands on, are 
essentially nonverbal methods. The demonstration/modeling technique requires 
the evaluator-to demonstrate the assigned, task, and the client then models his 
performance after the evaluator. The evaluator may perform a portion of the 
task, 'thecf ask the client to model the behavior(s) ,■ then the evaluator performs 
another operation, etc., until the 'enti re .task is completed ahj* eaclr of the 
separate steps tied together. Or the'evaluator may perforrh entire task and 
either ^sk the client to parallel his performance while it is taking place, or 
wait until the evaluator 's entire demonstration is completed. In any case, 
this method requires minimal language skitls and, as such, is simpler than v.he 
written or oral methods. 

4*. Hands °0n Method "-^ ^ ^ ' ' " , ■ ^ " 

The hands on technique has been widely .advoc-a ted for use with the severely - 
mentally retarded. Initially, i-t is similar to the dgmonstrati on/model ing 

■ • ■ . ■ ■ 



method >in that it requires the evaluator-'br trainer to demorVstrate a behavior 
or s6ries of behaviors and then have tKe client attempt tovpiodel the -behaviors. • 
Ho'weve.r, it is. different "from the denfonstration/mq^del ing technique in, that when 
the client fails to correctly perfoffm a task, the instructor physically manip- 
ulates the client's- fingers*,' hands, etc., so that the desired behaviors, e.g., 
brake assembly, occur. Individual behaviors are tied together in an organized 
sequence, and as the client learns each of the steps of. the task, he begins to 
make the phys-ical movements independently -so that when "learning is completed, 
it is no longer necessary for the supervisor to regularly guide the client's 
performance. This method is different from. the demons trati on/mode l.ing techn-ique 
in that the client's physical behaviors and movements may be controlled,' by the 
evaluatpr*. If a client is unable to independently imitate the correct behav- y 
iors, then the appropriate action is guided by the evaluator until the -client, 
can regularly perfoem the task accurately and independently'. With the demop'- 
strati on/modeling technique, however, demonstrations are usually repeated while 
the desired behaviot changes are made, but there is rio systematic effort to 
physically, manip^ate client's motiqns. 

Thus, one 'can see that there are itiany different Ways to provide instruc- 
tions to clients, and when working with individuals wtth learning disabilities 
it is imperative that the instructional format used be compatible with the cli- 
. ent's learning capabilities. Because this is a verbally oriented society, most 
job training programs emphasize verbal techniques. Likewise, most indivi.dual 
work samples and wodjj sampl.e systems use verbal instructional techniques (ofte;^. 
in combination with demonstration/modeling techniques). Yet many severely- 
handicapped oeople, which. often make up the majority of vocational "evaluation 
referrals, .have very poor vei^bal skills." Thus, the structure of the tests" 
themselves can create barriers which inherently impede client performance if 
the appropriate adaptation? are not made. By recognizing the importance of , 
providing 'appropriate instructional procedures, evaluatofs will often be able' 
to identify adaptations which may be made in the learning phase, so that cli- 
ents can learn to satisfactorily perform jobs which would otherwise be con- 
sidered beyond their abilities. .. ^ 

. Implications for Improved CI ient ..Awareness 

^ Another important 'benefit of learning assessment is that the client gains 
insight into his specific learning capabi 1 it-" s. For example, a client who is 
not .verbally oriented may have had a .great deal of difficulty* in school because 
he could not' learn ve'r'bally oriented informatls^n. Consequently, he developed 
a self-concept in which he-viewed himself as generally unable to learn most new 
skills and concepts. However, during learning assessment the client may find, 
that there are other nonverbal ways to learn information, e.g., demonstration/ 
modeling, hands on, which allow him to Succeed where he had previously failed. 
This leads to increased self-awareness which has practical application: the 
client asks an employer to demonstrate a task rather than providing him with a 
written manual . 



*For a more thorough discussion of this subject the reader is referred to the 
film, "Try Another Way," available from the Materials Development Center < 
Stout -Vocational Rehabilitation Institute, University of Wisconsin - Stout, 
Menomonie, Wisconsin 54751. Rental fees are: 3 days - $i5.00; 5 days - 
$20.00. * • ■ > ■ 



" Benefits for Job Placemen t/Tr aining ' . . • 

Finally, when the client is considered for job placement or training, .lim- . 
itatioiis in Ms learning skills ace very .important since job success is likely 
to be related t.c. his ability to learn the new job tasks via the instructional 
mocje 'offered by*>the employer.' For example, suppose that through learning as- 
■ sessment the evaluator finds that a client cannot ]earn most tasks by means of 
written formats. Unless the evaluacor or referral source are certain that a 
particula*- job does not 'requtro written learning sJeills, or that the employer 
is willing to make tlie necessary adaptations in the training program, then the 
'client should not fae plabed on the job 'even though he may have the potential to 
learn it if other instrufctional procedures were offered. -Imagine tjie hapless 
client who is- unable to tomprehend written instructions' but who is referred to 
a oob on wh*ch the .foreman typically hands new workers an operator's manual 
and tells them , to read it and start to work on the machinery. It is quite 
likely that in suoh a si tuation„ the client will perform poorly and the foreman 
wil V incorrectly attribute this 'to a lack of job related ability. The chent 
may then be discharged from the job because he is viewed as being unable to 
perform adequately.^ Learning assessment helps prevent these -^rpbl ems Since 
, the referral source and evaluator can determine if any adaptations are needed 
as well as employer wil 1 ingness to make them before job placement takes place. 

" In' this part we have identifiec^ iome of the reasons,..why learning assessment 
is important. First, it encourages evaluators to look at why a person cannot 
learn to perform a given -task rather than simply noting that the client, failed 
to perform adequately". This is important because evaluators often fail to look 
at the reasons for poor performance. Instead, they often automati-cally inter- 
pret poor performance as indicative of a lack of task related ability. This,^ 
however, is not always true since poor performance or learning difficulties may 
be the result of several fact«rs including: (1) inadequate instructional or 
learning formats, (2) motivation,- {3)- uncontrol led test environment ,• or (4) lack 
of ability, By .including learning^assessment as part df the evaluation process, 
the evaluator is determining the extent to which the .instructional format of the 
learning phase of^testing was compatible with the cl ient^learning-'capabi lities 

Learning assessment is also important because many handicappe^d-people can 
only learn by one or two specific fnethods. A client may be trnable to learn a 
task via a verbal format, but if the same i.nformation is provided through a non- 
verbal format, he may be able to learn to do the job. This fact has important 
ramifications for job placement and training since once the learning deficit 'is 
identified, evaluator, client, referral source,- placement person, and prospectiv 
employer can work together "^to modify the job training^xperience so as to over- 
come the client's Limitations. Finally., learning as^ssment also provides the 
client with insight into how he learns. This information can help the client 
learn to better cope wit-h the learning and training requirements of the job as 
well as tiis own personal , social , and educational experiences- outside of the 
work environment. The client finds that he can learn concepts and skills which 
he had previou$jly believed were beyond his ability. All of the aforementioned 
benefits make learning assessment an invaluable component of the overall voca- 
tional evaluation process, since it contributes to a valid and reliable under- 
striding of client limitations and capabilities. • 



.. ^ PART ni • 

' . PRACTI.CING. LEARNING ASSESSMENT* . . , 

Gold (1973) has stated tft^t with regard to the severely retarded: 

The basic concept of work" samples appears to provide the most 
f.-uitful approach tc evaluatiori. However, major changes iff^ present 
usage are necessary. Acquisition and prediction must be :separated. 
The length of time and conditions necess'ary to learn various tasks 
, should be separated from how fast production is after the tasks have 
' been learned. If both acquisition and production 'data are obtained 
on a variety of tasks and levels of difficulty, then hi'ghly reliable 
and descriptive data will be obtained and training wi )1 necessarily 
occur simultaneously with evaluation, (p; 129) • 

Gold's statement, however, not only applies ^o .the. severely retarded, btrt 
other handicapped people as well. Individuals v^ith learning disabilities such 
as aphasia or dyslexia will o,f ten "perform below their true abilities if the 
instructional format of the learning phase. is not Compatible with- their oWn 
unique learning abilities. % ' 

Recognizing the significance of separating learning and performance Wds 
'to addressing the problem of how this may be practically accomplished within a 
work sampje testing framework. The phrase,, separating learning and perft)rmance 
refers to the process of insuring that the client has thoroughly learned all 
aspects of what he is td^^do before he is requi»*ed to per^^orm a task. tHris as- 
sures that there^will -not be any significant level of continued leerjsirig during 
performance testing since the' client has' learned what to do iduring.the learning 
phase. Thus, his performance will. ^be an accurate reflection of his production 
capability since it 'Is not contaminated by continued learning, e.g., learnincj 
h6w- to correctly use the tools, the test answer sheets, etc. The basic problem 
then is how does an evaluator determine when the learning phasp is completed, 
i.e., sufficient client learning has tal^en place, and the client Is, therefore, 
ready to begin performance testi-ng. , • 

Methods of Separatinci Learning and Performance ' » •. 

In ord6>r to effectively separate learning ^nd performance and reliably 
determine when a client has learned.what he is to do, there are two important 
.measures which must be taken. . - " 

' 1. Work samples must have objective -criteria which are measurable aPicI 
define wheji adequati?. learning has taken place.. 

• 2. The ski lis \aha, concepts' that must be acquired during thfe "learning . 
, phase must '|)e representative of the skills and'concepts required 
during the performance phase. 

1. Establishing Objective 'Criteria ' ^ .. . 

With regard to the f1rs£ requirement, .^in order to reliably determine when 
adequate client learning has taken place, evaluators must have measurable and 
concrete standards which define "what constitutes adequate learning.' This is 

. V 
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most easily accomplished by identifying specific obdectives which the client^. . 
must achieve during the learciing phase. The evaluator may then .compare the 
client's learning phase performance with tlie standardized objective criteria of 



the 1earni<ng phase. In this way, the evaluator hajs a relatively easy job of 
determining if any client has mastered the learning- phase and^ is prepared fo 
the performance phase. 'For example, suppose an evaluator decides to administer 




However, in spite of the'advantages of .this procedure, it 'still has one ma- 
imitation. The problem is choosing the number of correct trials which are 
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statement establishes specific criteria which define when adequate ^client learn- 
ing has taken place asjwell as provides a standardized level which all clients 
must achieve prior to performance tes.ting. It should be nbted that there fs no 
reference to time or speed of pro<iuction because at this stage the Important 
factor .is whether or not "the clieitt can learn to accurately perform all phases 
of the task. Ninety percent aEcuracy is not acceptable nor are only three con- 
secutively accurate assemblies, likewise, according to "the standard, five 
consecutive and accurate assemblies with assistance from the evaluator or other- 
persons is also inadequate. The skills which the client must master prior to 
performance testing are concrete and measurable, and the overall effect of this 
approach is that at the conclusion of the learning phase, all clients who will 
proceed to the- performance phase will have acquired the saim skills and concepts, 
pecessary for performance testing.- In other words, the evaluator can be reason- 
ably certain that each client ha? learned the 'task. and thus, poor performance is. 
not likely to be due to inadequate instructional or learning procedures. ' 

jor 1 

believed to be necessary in order to assure that adequate learning can occur. 
Jn the previous example, it was stated that five consecu1;ive correct .trials -v/as 
the prerequisite to performance testing. How was this number arrived at? The , 
answer is that it is a subjective decision on the part of the work sample de- 
veloper. Perhaps fewer trials would be adequate,<feut"in this case the dev<3loper 
is certain thai five consecutive corr.ect as«erabl ies are enough to insure that 
the client thoroughly understands what he is doing. Although lengthy and expen- 
sive statistical analyses should be performed in o.rder to determine a certain 
minimum number of correct trials as indicating thatvlearning has occurred, this 
approach is usually impractical. The work sample developer must, therefore, 
concentrate on establishing adequate criteria so as to be reasonably certain 
that a client will understand what to do. 

2. Establishing Representativeness . . - '^ 

Establishing specific behavioral objectives alone v'i 11 not, however, nec- 
essari^'y guarantee that a client thoroughly learns a task prior to performance 
testing, unless *th€ learning phase skills are representative of those required 
for the perfo'rmance phase. For example, suppose that. a .sorting work sample 
.refi|uires i client to correctly sort five differently shaped plastic chips, 
e.g., round, oval, square, hexagon, "*nd rectangular. The behavioral criteria 
to be 'achieved during the learning phase, however, only state that as prereq- 
uisite to performance testing, "the client .will independently sort fifteen 
chips into three separate piles according to shape, with 100% accuracy. The 
client is then given several round,- .square, and oval chips whic!^ he must learn 
to sort according to the aforementioned cri.teria. The problem with this situ- 
ation is that although specific behavioral .criteria were established, they are 
not representative of all the skil^:S required for the performance phase,. In 
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this instance the client is only requiredUo discriminate among three different 
shapes- during ;:he learning phase, yet ^n tn^ pe»;formance phase,' he must be able 
td" differentiate five shapes, .i.e., square, round, oval, rectangular, and hex- 
agonal. Thus, the behaviors acquired during the learning phase are not 
;representati ve of -an those required for the performance phase, ^ince it can- 
rtot be assumed that learning to differentiate among square, v^pund, and oval 
implies ^ho ability to discriminate the other' two shapes equally effectively. . 
The learning phase criteria should be rewritten to read, "the client will in- 
dependently sort 25 chips of five different kinds (round, square, oval, 
rectangular, and hexagonal) into five equal 'piles according to shape, with ^100% 
accuracy, prior to performance testing." This statement clearly identifies 
learning phase criteria which are representative of performance "phase skills. 

Another example of this problem is the case wherein a client is allowed' to 
learn a task at less' than 100% accuracy during the learning" phase but is then 
penalized for less than 100% jiccuracy during the performance phase.. For ex- 
ample, the beiiavioral criteria might state that the client must, "independently 
assemble teo consecutive widgets with a minimum of 75% accuracy on each unit" . 
during the learning phase. When this level is achieved, the client may then 
proceed to the performance phasd where at the .conclusion of testing he finds 
that he has been penalized for performing at a level which he learned was ac- 
ceptable in the learning, phase, e.g., all widgets lacking 100% accuracy are 
thrown out in^acountjng- up total uffits asfsemblgd. In this case the client has 
unfairly learned to .perform at a leveVwhich is not representative of the per- 
formance phase'criteria.- Thus, the- instructional procedure should be viewed as 
inadequate and any, predlctfbns as to performance capability sjiould take this 
problem into account. , ^ ' V 

Assuring learning phase representativeness is a difficul t'but necessary 
task. It essentially requires that the evaluator^ identify the performance he 
wants and thfen develop learning phase ..instructional and experiential procedures 
which will insure that the client: (1) can-perdelve-and-uftderstarid the' ins true 
tions, *(2) can 'be. taught the proper use of all the tools and equipment us^d in 
the performance pfiase,, (3) can learn all the steps and motions required in thei 
performance phase, and (4) can be made aware of the desired result. Perhaps 
the best way to achieve this is to systematically identify eaeh of the perfor- 
mance phase 'behaviors through techniques such as- job analysis or task analysis, 
and then 'incorporate these behaviors, albeit on a smaller scale, into the .learn 
Ing phase. For example, if the performance phase of a mail sorting work sample, 
requires a. clienj: to \correctly sort three hundred envelopes alphabetically and 
numerically, th^ti the evaluator might have twenty practice envelopes which the 
client must, "sort independently, and with 100% accuracy, by name and number, 
prior to. performance testing." Such an approach is a reasonable effort on the 
part of the evaluator to insure representativeness during the learning phfise, 
without getting involved in lengthy and time-consumjng statistical analyses of 
the performance phase behaviors. ^ ^ 

thus, one can see that the learning phase must be representative of the 
performance phase. Other^/ise, even though the client may master all the be- 
haviors identified i'n the learning phase, he may still not have acquired all of 
the behaviors necessary for test performance. In such a case it is very dif- 
ficult for an evaluator to. determine the extent to whicji poor performance we|s 
the result of lack ot ability or test administration inadequacies. Yet this! 
relationship must be^ecognized and jjnderstood if a .valid picture of the cli- 
ent's abilities is to enterge. ' , * •• - . 



Developing Appropriate Instructional Techniques , 

One important point to keep 'in mind is that- the standardized instructional 
format provided-^ a ywork saniple manual should be the same as the method used ^ 
'to train employees foV the same or similar jobs in competitive industry. Most 
training programs utilize a verbal format, and although the .ability- to follow 
written instructions may not a^ways be required, nearVy all jobs require some 
degree of ability to follow oral instructions. Practically speaking, mojjt 
training situations use'a combination of instructional techniques, e.g., writ- . 
ten, orals, and demonstration. Thus, if several learning styles are necessary 
for satfsfacJtory job performance, then each method should be incorporated into 
the wbrk sample. 'Otherwise, clients may be screened out of jobs they can ac- 
tually perform, or they may be placed in jobs which they cannot perform because 
their learning style is nqt compatible with the training format, 
• •• . 

• For example, if a job' training program* requires reading, but the worl^ sam- 
ple utili7.es a deTOStrati on/model ing instructional procedure, then the non-; 
reading client may be able- to perform the work sample; but when referred for 
job placement, the employer may discharge 'him due to inability^ to follow the . 
reading oriented trainiirg- program. If, on the other hand, the work sample 
simulates the learn^ing patterns used on the job, then the evaluator can-more^ 
reliably 'ytermine if the cliet t can follow the .instructional procedures that 
are off- on the job, if not, what adaptations in the training may be t 
made, anu is the employer willing to make the fiecessary adaptations. Thus, the 
special needs, limitations . and capabilities of the^client's learntng. skills 
are tfiven careful consideration. In any case, the ma^or concern when designing 
learning phase instructional formats shou'.d be to provide learning formats which 
parallel -industry rather than formats which are convenient for the evaluator, - 
e.g. . written 'formats for all work samples s5 'the evaluator won't . have to spend 
time reading instructions to cliei.wS. ^If a client cannot. learn the matef-ial by 
the standardized format", then other methods must Be tried and these adaptations 
'must be kept in m'ind when considering job placement or training.. 

•' ■ • . ' ■ ' 

Adapting Standardized Work Sample Instructions • ^- , ^ 

•* Even thou'gh a work sample may have objective criteria, be representative, 
and have appropriate instruction^techniques, there is still .a problem as to 
what should be done When a client fails to complete the learning phase by fol- 
lowing the standardized instructional format. Should the same instructions be 
repeated several times until the client actually understands them or the eval- 
uator decides that the client cannot learn them? Can J:esting automatically be 
d.iscontinued if the client can. lOt- follow the instructions after one'or two » 
administrations? ShoiPd tho evaluator proceed to performance testing regardless 
of whether or not a cl^ient has learned what to do? • Should the instructions |^ 
modified so as to facil itata. client learning? These are difficult questions^nd 
one must keep in mind that work sample administration procedures have generally 
emphasized the importance of providing the same standardized instructions to all 
clients. Yet; it has already been noted that although some clients are unable 
to learn a task via one instructional format, they may be able to learn the 
same task if a different fQrmat is provided. TlUs, one cannot assume that be-- 
cause a client fails to complete the learning phase following the standardized 
format, that he necessarily lacks the task related abilities. Therefore, other 
instructional techniques, e.g., written, oral, demonstration/modeling, or hands 
on must be provided to the client when he cannot follow the standardized in- 
structions. It' is only by doing'^this that the eval uator. may determine if the 
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client Is 'capable of learning the' task regardless of the learning phase* inS'truc- 

tfonal format used. ' ° 

f ■ ' . ' ■ . 

For example, suppose a sor.ting work sample is administered to a severely 
retarded client. The work sample contains specific behavioral cxiteria which 
define when the learning phase is comple^d and the criteria are rSpresfentative 
of the performance phase. The instructional format para,i:iels that used in in-* 
dustry, e.g., a combination of oral and demonstration. Yet, the client is 
unabfe to master the skills and concepts outlined in the behavioral criteria.. 
In this case,- should the evaluator necessarily interpret t+ie client's diffi- 
culty as Indicative of a lack 'of task related ability?" The answer is no, for 
until the ievaluator has -provided all of the other instructional. formats, he 
cannot be certain that; the client cannot Team the task. r. 

Is tMs case, because the client cannot repd, a written format would not 
have to be provided. The evaluator might attempt to separate the demonstra- 
tion/modeling and oral techniques and provide them* separately. If the client 

• stin cannot learn the information, then the evaluator should try the hands on 
technique. If the client still cannot ^earn the task, then the evaluator is at 

' least certain*that the client's learning problem is not due to inadequate in- 
structional procedures. He must then attempt to determine if it ii the result 
of: (1) the testing, environment, (? ^not ivati on, *or (3) lack of ability. 

There is no standard procedure for choosing other formats when the standard 
one does not "appear to 'be satisfactory* However, a good general t;;jiJe to follow/ 
is to icecp the technique chosen-^ ^close to the actual Training format of in- / 
duStry as possible and usually jSrovide secondary techniques which are simpler / 
than the standardized formatv For example, if a written instructional format / 
is inadequate- because M learning disability like dyslexia, then the evaluatof 
"might first provide oral instructions'which are also verbally oriented, If this 
fails* then he may pirocee'd to nonverbal techniques, e.g., demonstration/mode/lingi 
. and, finally, hands on. Similai'ly, if a client cannot learn a task following a 
nonverbal techliique sOch as demonstration/modeling, then ^ the evaluator should 
offer the simpler, nonverbal, hands on technique rather than the more complex 
written or oral methods. , * ' > ^ 

.* ^ Whenever an evaluator finds it necessary to break away from a standardized 
Instructional technique, he should. carefully note what other techniques were 

* used, why they were necessary and the degree of effectiveness. ' Evaluators- 

A should also observe how much additional training was needed during the learning 
phase and the extent of supervision required. This information provides impor- 
tantibata for job placement and. possible redesign of job training experiences. , 

\ Breaking away from standardized instructional procedures is important for 
three reasons: v 

. i. ' It reduces the probability of evaluators misinterpreting performance, 
: - e.g., automatically attributing poor performance to lack^of ability 
rather than considering ijnadequat^ instructional procedures. 

2. It increases evaluator and client understanding of the Tatter's learn- 
ing, skills, e.g., written, oral, demonstration/modeling, and hands on. 

3. It provi(|es valuable information r^gar(ring client learning ability when 
considering placement 6r .training potential, e.g., job training re- 
design. , . , 



the advantage of this approach Is that client, referral sour^ce, and evalu- 
ator obtain a thorough and rellablfe picture of client'capabilities and limi- 
tations. The basis of this understanding Is knowledge of how-a client learns. 
Dunn (1971) pointed out that: . . 

■ ' ■ * ■ ■ . * . ■ • • • 

The result of this approach to work sample instructions is that the ^ 

. .. actual instructions given la the clients.will not be 'standardized' 

(In the sense of having one set of Instructions which are used for 

• all clienis), but the outcome of the instructional process wil.l be 
•standardized' (In the s&ise that all clients will have the Same 
leveUof task mastery when they begin the work sarnf51e). When the 
work sample Is 'adm1nistere«t, rate of perfonrance can be reliably^ as- 

• sessed and meaningful comparisons of the differences between clients 
can be made. Additionally, since it has already been determined 

* that the client can perform the. task with accurajcy, the effects of 
Increased performance me or quality. can be determined, (p. 2) 

Thus; ohe can see that the advantages of this approach are twofold: ' 

* 

1. Emphasis is placed on standardizing the outcome of the acquisition or 
* leaiiilng Dhase rather than the instructional technique. This insures 

' that all clients possess the same essential skills when they begin 
performance testing. . . 

2. Primary "effort is placed on simply determining whether or not a c\4- . 
• ent can or cannot learn to perform a task. Concern over predicting 

future*, levels of productivity is minimized. Such predictions tend* ' 
' ■ to screen "slow learners" out of jobs or training programs in which 
they might be able to function if they were given additional -training 
or time to learn the* task(s). The basic fact that a client can per- 
form a'job, regardless o>«p^ed, suggests the potential for improved 
performance with addit«mal training. This Is particularly important 
when assessing severely handicapped clients who have general or sper 
cifix: learning disabilities. 

It should be understood that it is not being advocated *^that because there 
are four basic instructional techniques, every work sample must contain four 
separate sets of standardized instructions. Such an approach would be time- 
consuming and costly. In addition to this, the majority of clients will be 
ab-le to complete the learning phase of a work sample by following the standard- 
ized instructions, since piany clients will not have learning problems, e.q.,. 
clients with' orthopedic disabilities. What is being sugqested is that one stan 
dardiied instriictional format which simulates industry should be developed tor 
each work sample. When adaptations are necessary, the evaluator should be able 
to intuitively modify the standardized instructions so as to facilitate cliervt 
learning and satiny the behavioral criteria outlined for the lear/iirrg phase. 

In, Part III we^'have discussed methods of separating learning and perfor- 
mance arid pointed out that when clients cannot learn a task via the stan- 
dardized training format, then other techniques which may be more compatible 
with their learning-patterns must be provided. . , 

Separating learning and performance essentially requires the evaluator to 
.Identify, in -concrete and measurable terms, the behaviors' which he wants the 
client to possess at the Oopclusion of the learning phase. These behaviors 



must be representative pf those required in the perforrnsince .phase and the stan- 
dardized instructional format should parallel. the training format used in 
competitive industry^. Once this is accomplished, the evaluator has a clearly" 
defined standard whicfj, allows him to determine when a client has satisfactorily 
learned what he 13 to do and Is, therefore, ready Jo- oerformjance testing. « 

Of equal importance is the fact that when a client cannot learn a task by' 
means of the standardized Instructional format, it cannot automatically be as- 
sumed that this- Is dae to lack IS'f task related ability. Rather, it may be "the 
result of other factors including: (J.) inadequate instructional or liearning 
procedures, (2) testing environment, and (3) moti-vation. In order to. assess 
the adequacy of the Instructional procedures, the svaluator mus.t proj/lde other 
learning formats which may be more compatible with the clierif's own unique 
learning style. In choosing a differojit^arriing format- the evaluatpr-should ' 
begin with the one that is most similar to the standaVdlzed format', i.e.*, 
v.erbal vs. nonverbal techniques, and generally woj:k from a more complex to a 
simpler foNat. ' " — ' 

The net effect of separating learning and performance and providing a* va- 
riety of instructional technique! is that the' learning. phase of .work sample 
testing' is standardized. That is to say that at the conclusion of the learning 
phase, all client^' who will progress to the performance phase will possess, the 
same essential skills' required for performance. Jhus, a more valid and reli- ' 
able understanding of client performance is possible, e.g., poor performance 
is not likely to be the result of inadeqi/ate instructional or learning pro- 
cedures. Additionally, a more thorough understanding of client learning . 
capabilities is developed and- this provider important information for job place 
ment and training". . • * - 



SUMMARY 



" • Learning assessment- is a process which attempts to systematically identify 
and explain how a person :)earns. It is important because all jobs require some 
degree of learning, ye't if a person has learning deficits which have not been 
identified, the potential for misinterpreting performance problems as" indica- 
tive of a .lack of task- related ability is great. However, .onqe a client's 
learning problems are thoroughly understood, evaluator, client, counselor, ^nd 
employer can" often adapt th? work/training environment so as to facilitate com- 
petitive performance. * \\ » " 

. * 

'Performance and. learning are two, closely related but distinct concepts 
which form the basis of learning assessment. With regard to vocational evalu- 
ation*, learning lind performance. can be separated by identifying the learning 
and performance phases of work sample testing. The learning' phase is the pe- 
riod during which the client acquires all the behaviors needed to perform a 
task. It necessarily involves some degree of training since i-.t is at this 
stage that the evaluator instructs the client in the skills, concepts, motions; 
etc., needed to perform.' the job.. The performance phase, on the other hand, . 
follows the learning phase and is the 'period wherein the client is actually re- 
quired to produce the learned behaviors under formal testing conditions. The 
two phases should be- separated by identifying observable and measurable behav- ^ 
iots which the client must m'aster prior to performance testing. The behaviors ^ 
must be representative* of the behaviors required fpr performance testing and. 
the instpucfeton'al format -used during the learning phase should parallel, that 
used "in industry for similar jobs. This procedure results in the^ development 
-of concrete and measurable standards whicn define when the client has completed 
the learning phase and is, ready for. performance testing. " 

Four basic instructional methods have been dis,cussed— written, oral, dem- 
onstration/modeling, and hands on. The first two techniques are verbally 
oriented and more complex than the other two nonverbal methods. Although most, 
people can learn by a>l of these modes, some individuals wi th^speciric or gen- 
eral learning disabilities are' only able to learn by one or two methods. Thus, 
if they are given instructions"via a format which is not compatible with their 
learning styles, the ressulting performance may not be representative of their 
true abilities simply' oecause they did not thoroughly understand the instruc- 
tions. Unfortunately, in many of these cases, the poor performance is commonly 
erroneously attributed to lack of abil ity rather than inadequate instructional 
procedures. . ' ' • * ' 

Perhaps the single most important point fnr evaluators to keep in mind' is 
that if a -client cannot learn a task via one standardized instructional method, 
then ft is imperative that alternative instructional formats be^offered. ^This 
is primarily because a pei^^on with a learning disability such as aphasia or 
mental retardation may be unable to learn certain information via'S one instruc- 
tional technique but could learn the same information if another instructional 
technique-was provided. Additionally, in some cases clients will 'be able to- 
point out their learning problems, but in many other instances they will not 
be fully" aware of their handicaps or they may attempt to hide them from the 
evaluator. Both of these problems emphasize the importance of evaluators sys- 
tematically examining the" reasons for performance problems and identifying 
' clients who have potential learning deficits which are adversely affecting per- 
formance. This' procedure is certainly far more beneficial than simply 
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*recording instances of performance problems without trying to datermine if the 
difficulties ara related to subtle learning problems. 

The^benefits of separating learning and 'performance are many.. First, 
evaluators gain a more reliable and valid picture of client capabilities once 
they are certain that the client: (1) perceives'-sind linderstafl^s the instruc- 
tions, (2) knows. the proper use of the tools and. eqii^ipment, (3) learned all 
the steps and motions, and (4) is aware of the d^s+red resMlt. Assuring that ' 
thfese objectives are achieved i's one of the major functions of the learning 
phase of work sample nesting. On'ce these criteria are satisfied, substandard 
cTieiit performance is not likely to be the result of inadequate instructional 
formats. The evaluator may then examir\^ other* possible causes' such as client 
motivation, testing environment, and lack of ability. 

The second major advantage of separating learning and performance 'is that 
the behaviors which the evaluator wants the client to jnaster during the learn- 
ing phase are identified. Thus, maraisurable and observable criteria which 
define adequate pre-performance pl>ase leafrting are established. All clients 
who proceed to' performance testing will, therefore, possess the same essential, 
task related behaviors. Emphasis is placed on s^dardizing the outc^)mes ctf 
the learning phase as opposed to the instructional technique , used. 

Additionally, as a result .of Teaming assessment, the^client t\ioroughly' 
learns and understands what he is to do before h& is required to perform a 
task so evaluator ,° referral source, and client have a sound understanding of 
how the latter Teaf'^s. Learning problems and their implications for perfor- 
mance interpretation are evaluated. This process has important implications , 
for employment and training since once learning deficits, are identified and 
Understood-, methods of adapting instructional format! so as to facilitate cli- 
ent learning may be developed. Thus, clients can be placed in^obs'or training 
programs which, without learning assessment-, mi^ht mistakenly be^ regard.ed as 
beyond .their abi'li ties. " 

In conclusion, it should be understood that the learning assessment pro- 
cess can also be incorporated with ottier vocational "evaluation .techniques?. Job 
site, situational assessment, and job sample testing all require the client to 
learn new skills and concepts which must be mastered before an individual can 
^be expected to successfully perform the job. Regardless of the assessment 
technique used, it is aTwa^s necessary for the vocational evaluator to be cer- 
tain that the instructional* techniques provided are compatible with, the client*! 
learning abilities. If they are- not, the evaluator must adapt the learning. sit- 
uation by providing alternative instructional techniques which may. help clients 
learn the necessary behaviors. By. satisfying this important pri nci pie ,^he 
evaluator gains a more .reliable and vali.d understanding of the ^tli'eht'^wca- 
tional strengths- and limitations and thus a better service is provldecL ^Most 
important, however, the client 'also, benefits because there femeVges;4* bet^r ' v 
and more accurate understanding of his abilities; * .\ 
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